Functions of Speaking and Acting - An Interaction Model for Collaborative Construction Tasks

This paper describes how a virtual agent assists a huam user in collaborative construction tasks by combining manipulative capabilities for assembly actions with conversational capabilities for mixed-initiative dialogue. We present an interaction model for representing the evolving information states of the participants in this interaction. It includes multiple dimensions along which an interaction move in general can be functional, independent of the concrete communicative or manipulative behaviors comprised. These functions are used in our model to interpret and plan the contributions that both interactants make.